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TELEVISION! 4APTI TUDE , ^ACADEMIC PERFORMANCE! +TESTS OF 
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TO TEST THE ASSUMPTION THAT LEARNING EFFECTIVENESS VIA 
TV MIGHT DECLINE DUE TO LENGTHY VIEWING TIME AND FATIGUE ( 

THIS STUDY COMPARED EFFECTS OF 36 HOURS OF CONTINUOUS TV 
TRAINING IN 5 DAYS WITH REGULAR CLASSROOM INSTRUCTION OVER 
THE SAME PERIOD. EFFECTIVENESS OF THE MINIMAL TV 
PRESENTATIONS THAT TRANSMIT EXISTING CLASSROOM INSTRUCTION 
WITH NO SCRIPTS! PROMPTING DEVICES! OR SPECIAL TV AIDS WAS 
ALSO EVALUATED. TV INSTRUCTOR QUALIFICATIONS WERE STUDIED. OF 
6 GROUPS OF 261 TRAINEES IN THE POWERMAN ’ S ELECTRICAL 
MAINTENANCE COURSE, 4 RECEIVED TV INSTRUCTION AND 4 REGULAR 
INSTRUCTION. THERE WERE NO CONSISTENT DIFFERENCES IN TEACHING 
EFFECTIVENESS OF THE 2 METHODS. ON 10 IMMEDIATE POST-TESTS, 
REGULAR INSTRUCTION WAS SIGNIFICANTLY MORE EFFECTIVE THAN TV 
INSTRUCTION! BUT ON RETENTION TESTS 1 MONTH LATER, TV WAS 
JUST AS EFFECTIVE AS REGULAR METHODS. AFTITUOE LEVEL, RATHER 
THAN INSTRUCTIONAL MEDIUM, WAS THE BETTER PREDICTOR OF TEST 
PERFORMANCE. MINIMAL TV IS RECOMMENDED FOR USE OURING 
EMERGENCIES OR FOR NEW MILITARY TV TRAINING PROGRAMS. DATA 
ARE REPORTED IN TABLES SHOWING STATISTICAL SIGNIFICANCE 
LEVELS BASED ON ANALYSIS OF OF VARIANCE AND T-TESTS. (LH) 
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This report has been prepared under the joint efforts of the 
Audio-Visual Applications Office 3 Army Pictorial Service Division, 
Washington 25, D. C., and the Television Division, Army Pictorial 
Center, Long Island City, and is published for the information 

and guidance of all concerned. The report is a compilation of the 
results of studies conducted at Fort Gordon, Georgia, to demonstrate 
methods of implementing television techniques in standard classroom 
instruction and to evaluate their effectiveness for standard class- 



room instruction. 
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THE SIGNAL CORPS TELEVISION RESEARCH PROGRAM 



The present study is one of a series steaming from a joint Signal 
Corps research program# The program represents a coordinated effort by 
the Any Pictorial Service Division, the Combat Development and Operations 
Division, OCSigO, the Army Pictorial Center, and the Signal Schools at 
Port Gordon, Georgia and Port Monmouth, New Jersey# In August 1955, 
representatives of these organisations developed a long range program 
of research, designating critical areas of informational needs (13)# 
Underl ying this research program were two basic information targets# 

The first of these was the potential role and application of television 
during periods of emergency or mobilisation# A previous study (7) had 
alr eady indicated television’s ability* to teach a variety of military 
subject matters at least as well as conventional classroom instruction# 
This teaching equivalence, combined with television’s ability to reach 
large or scattered groups of trainees, pointed out an Important potential 
military use for television as a training and informational medium both 
in emergency and routine requirements# 

It was also apparent that more information was needed concerning 
the effective uses of television for every day military training# Of 
immediate interest war© such questions as instructor requirements for 
television teaching, television cost factors, intensive television 
instruction and reduction of teaching time# 

Two studies were planned whose results would cut across many of 
the above areas of interest# The firsts described in this report, was 
designed to evaluate the effects of "intensive** television teaching# 
Previous uses of television teaching have been limited to one or two 
hours a day*# There was an interest in the possible use of television 
for much longer periods of instruction# Such use, if possible, showed 
promise of reducing training costs when combined with television* s 
potential for teaching large groups and using less expensive training 
aids# Related to this intensive use of television for teaching was a 
need for information on production problems for the continuous presen- 
tation of television instruction# The second study essentially was a 
continuation of the first, using the same subject matter# Its purpose 
i*as to attempt reductions in training time with television techniques, 
to further investigate television instructor requirements, to test the 
effectiveness of filmed instruction and to determine cost savings 
permitted by television instruction# 



* i#e#, one or two hours per day for a particular subject# 
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REPORT SUMMARY 



Background 

Nu me rous studies have already established that television can 
teach at least as well as regular classroom instruction in a variety 
of subjects. In these studies, relatively short segments of televis- 
ion and classroom instruction were used and they did not explore 
bv television over extended periods of time* At present, 
it has been determined that television may effectively teach a 
particular subject for a period of one or two hours a day* This 
abbreviated concept of presentation is in contrast to conventional 
classroom methods of instruction where subject matter is presented 
over extended periods of weeks or months. Were it possible to 
instruct by television over the same periods of time, more effe drive 
use of this instructional medium could be made during times of national 
emergency or in every day military training# One instructor could 
teach thousands of students via the television receiver and almost any 
building or room could be quickly converted into a classroom* The un- 
tested assumption that effectiveness of learning might decline vexy 
rapidly because of lengthy viewing time, fatigue, or similar factors, 
has retarded the use of television for more extended periods of instruction# 

In addition to the primary aim of testing this assumption, there 
was an interest in evaluating certain rapid television presentation 
methods. These methods, labeled as "minimal" television, employ tele- 
vision to transmit existing classroom instruction, with no effort to 
use scripts, prompting devices, aids or specific television instructor 
training. Instruction by "minimal" television has the advantage of 
req uir in g less time and cost in preparation than instruction which 
has been specifically designed to utilize available studio, camera 
and teaching techniques. These economies in time and money may 
satisfy a critical need during periods of emergency. For everyday 
training needs, "minimal" television provides low-cost, rapid instruct- 
ion. Prior to any recommendation for its use, however, the beaching 
effectiveness of "minimal" television would have to be compared with 
conventional classroom instruction. Advantages and disadvantages of 
"minimal" television are presented In Appendix I# 

Purpose 

It was the purpose of this study to c ompare the effect upon learn- 
ing produced by 38 hours of continuous television training over a five 
day period, with that produced by a similar period of regular classroom 
instruction. A secondary objective was to evaluate the teaching 
effectiveness of "minimal" television presentations. Thirdly, the 
study evaluated the preparation and training requirement needed to 
qualify personnel for teaching extensive segments of subject matter 

over television. 

Method 

Trainees at the United States toy Signal Training Center, Fort 
Gordon, Georgia, entering the first seek of the Powerman's Course. 



(WOS 35l), were 'taught either ty television or in the regular classroom* 
Groups trained under either condition received ten written tests for 
the five days (38 hours) of instruction. The results of these tests 
served as the basis for comparison between television and classroom 
trained students* in addition, a retention test was given to both 
groups about one month later* The same materials and instructors were 
used in the television and classroom instruction and no attempt was made 
to modify classroom instruction for television presentation* 



Results 

There were no consistent differences in teaching effectiveness 
between television and regular instruction* 

Regular instruction was more effective than "minimal" television 
instruction on immediate test scores* 

Television instruction was as effective as regular instruction on 
retention test scores* 

Aptitude level, rather than instructional medium, proved to be the 
important determiner of test performance. 



Conclusions 



Using instruction similar to that employed in this study, television 
training may be extended to at least five days (38 hours) without any 
greater decline in learning than that produced by regular classroom 
instruction* 

Wldle the immediate learning produced by "minimal" television 
teaching may fall below classroom or improved television instruction, 
it is remembered at least as well* For most types of military instruc- 
tion^ retention and application of information at a later date is the 
more important criterion. The sole use of "minimal" television, however, 
may hinder development of more effective television teaching methods. 

Because of its low cost and time saving features, "minimal" 
television is recommended for use during emergency periods or for 
military installations just beginning a television training program* 

For such installations, the use of "minimal" television methods provides 
a rapid, inexpensive means of disseminating large segments of Milit ary 
instruction. In addition, it also provides valuable initial experience 
in the use of television for training* 
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To achieve improvements in television teaching, and to make fall use 
of television’s presentational features, "minimal** television procedures 
should be followed by procedures to adapt television techniques to subject 
matter* 

The study 1 8 evidence on the important role of aptitude in learning 
points to the recommendation that improvements in trainee selection 
pynggHwgg yntiij jfstcil j.tsts trsising probleras in ths Ponsnssn^s Cchtss# 
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Chapter 1 

STATEMENT OF PROBLEM AMD RESEARCH METHOD 

The present report is based on an experimental study carried out at 
the U. S. Amy Signal Training Center, Fort Gordon, Borgia, f«»i 
January to April 1956. The study is one of a series designed to explore 
and develop the us© of television for military training purposes. 

Background 

Previous studies have established that television can teach least 
as well, as conventional classroom methods (1, 3, 5, 7 >10, HJ* 11118 
factor of teaching equivalence, therefore, was not * primary concern of 
the present study! The main interest lay in further developing the use 
of the television medium itself for military training. One area of de- 
velopment considered of Importance was the possibility of using tele- 
vision more intensively. Generally, television instruction ^r ^ny one 
subject matter has been limited to one or two hours a toy. 
eight hours a day may be devoted to television instriKtion, for example , 
at Fort Gordon, this would be spread among as many different subj 
matters and groups of trainees. There was no recorded instance of using 
television to teach one subject matter for an entire day, 
several days, as typical of conventional classroom inftruction in «y 
milit ary subject matters. The advantages of using television for mU.itary 
instruction would be amplified were such intensive use possible. During 
emergency or mobilisation periods, the ability to use teievision iriten- 
sively to teach large segments of instruction would prove a valuable if not 
mandatory moans of c oinnunf c ation and training • 



Purpose 

A major objective of the study was to determine pother television 
could be used to teach large segments of military instruction without 
impairing teaching effectiveness. A subsidiary obje ctive was toev^uate 
prodaction techniques associated with the type of television training 
employed in this study so as to provide guidelines for future use of the 

medium. 

The Possible Effects of the Intensive Use o f Television 

Continuous exposure to any method of instruction is probably accom- 
panied by a progressive decline in learning efficiency, with the degree 
of decline depending upon method of instruction and type of su^ec 
matter. In this study, the objective wae to determine the degree and 
naiure of^this dadirw^for television as compared with ^g^ olassroom 
instruction, using the subject matter contained in the Powerman s Course. 

Subject Matter 

The first week of the Powerman's Electrical the 

(MOS 351) at the Signal School, Fort Gordon, was selected for use in the 
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study* The purpose of the Powerman* s Course is to train selected 
enlisted personnel to install, operate, and perform organizational 
maintenance of portable electric-power generating equipment* 

Essential to the successful performance of their mission is a 
thorough grasp of the fundamentals of electricity as related to 
their jobs* For example, a Powerman would hare to know not only the 
principles of magnetism and their relation to electricity but also 
how to change a battery as well* 

The first week of the course is chiefly concerned with the 
principles of electricity and covers such subjects as first aid, 
electricity, magnetism, test equipment, Ohm*s Law, parallel and 
series circuits, the reading of diagrams, grounds, electro-magnetism, 
induction, transformers, storage batteries, the RA-91 rectifier, the 
charging. of storage batteries, and maintenance records* The instruc- 
tion* as normally presented, included lectures, a number of training 
films, and practical exercises in which the student had an opportunity 
to apply what was learned in the lectures* This portion of the 
Powerman*s Course is very typical of a variety of electronics courses 
and training given in the Army* 

Trainees 

♦ 

The trainees we^c 281 enlisted men assigned to the Powerman *s 
Electrical Maintenance Course (MOS 351) at The Southeastern Signal 
School, Fort Gordon, Georgia* Information, including the aptitude 
test scores of the trainees, was supplied by the School’s Record 
Branch* Trainees were not informed of the fact that they were partici- 
pating in an experiment* Fort Gordon has been using television for 
training for about six years, and television instruction is not con- 
sidered a novel method of teaching* 

General Design 

Trainees entering the first week of the Powerman’s Course 
received instructions exclusively by television or by regular classroom 
methods* Table 1 indicates the rotation of television and regular 
instruction used in this study* 

TABLE 1 



Alternation of Television and Regular Instruction Methods* 



Week 


Method 


Weak 


Method 


1st 


Regular 


5th 


TV 


2nd 


TV 


6th 


TV 


3rd 


TV 


7th 


Regular 


Uth 


Regular 


8th 


Regular 



*It was originally planned to have an ABBAABBA order to control for 
possible systematic week-to-week variations, but, due to reasons 
beyond the experimenters’ control, the order had to be changed* 
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The instruction was the sane for all groups. It was divided into 
10 sessions, $ morning and 5> afternoon periods, with tests administered 
at the end of the morning and afternoon sessions to measure immediate 
learning. A retention test was administered about one month after the 
end of the first week of instruction. 

This design per^iits a comparison of the teaching effectiveness 
of television and regular classroom instruction after various amounts 
of viewing time. It is most likely that the rate of trainee learning 
declines as the amount of instruction increases in both television and 
regular classroom instruction. The purpose of this study is to determine 
whether the rate of decline differs for the two teaching procedures. 

For example, is learning more impaired by intensive television in- 
struction as compared with intensive regular classroom instruction? 
Trainee performance on the 10 tests used would provide evidence on 
this question. Such evidence would be in the form of a systematic rate 
of change in test scores favoring one method over the other. 

Figure 1 indicates a few of the many possible outcomes of the 
study. Graph (a) exemplifies an outcome indicating that increased 
viewing time increases the differences between media (shaded are? • 

Graph (b) exemplifies an outcome indicating that increased viewLig 
time decreases differences between media (shaded area). Graph (c) 
exemplifies an outcome indicating that the differences between media 
are not affected by increased viewing time. 

It must be stated at the outset that the design is not very 
sensitive to small differences in losses in teaching effectiveness. 

This fact does not decrease the value of the experiment to any 
great extent, since a small change in differential teaching effect- 
iveness would not be of any great consequence. Conversely, any 
increase in the sensitivity of the experiment would have required an 
extremely large increase in expenditures of man-hours and money.* 



* For further discussion of the experimental design, see Appendix A* 
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Figure 1. Hypothetical results indicating possible outcomes 
of the study* 



4 



o 



Chapter 2 

PREPARATION OF TESTS AND INSTRUCTION 
Immediate Testing 

Evaluation was based on the results of written tests given to the 
trainees immediately after instruction. Since it is not generally Amy 

P maaaAmma 4- A o a-T *Lrav»j» Ano<4 
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for tne study, containing a total of 296 items* The items were ii-alter- 
native multiple choice and were constructed with a view to making them 
easily understood and unambiguous. An attempt was made to have items of 
varying difficulty, with the average difficulty being high enough above 
chance to avoid the floor effect* and low enough to avoid the ceiling 
effect*. Wherever possible, items employing pictures or diagrams were 
used.** The ten tests were tried out on three regular instruction 
classes. Items that were too difficult or too easy and items that were 
poor discriminators,*** were either revised or dropped. 

The tests were partly mimeographed and partly zeroxed. The test 
instruction sheet was that employed by the Test and Evaluation Branch at 
The Southeastern Signal School. The answer sheet was the Amy Standard 
Answer Sheet for scoring with IBM machines. A test was administered at 
the end of the morning and afternoon instruction over a five day period. 
Students were instructed to answer all questions even if they had to 
guess. Figure 2 shows trainees durirg a test administration period. 

Retention Tests 



The format of the Powerman f B Course offered a rare opportunity to 
administer retention tests about one month after the one week segment 
used in this study. Normally, after this one week is taught, trainees 
are given instruction in diesel and gasoline engine operation and similar 
materials generally unrelated to the first week 1 ® electronics instruction. 
This instruction continues for about one month and then the students re- 
turn to electronics instruction. The instructors, therefore, are more 



* Differences between groups are minimised or eliminated when test 
items are so difficult that few trainees are able to answer them 
correctly (the floor effect), or so easy that most trainees are able to 
answer them correctly (the ceiling effect). 

** See Appendix B for examples of test items. 

*#* The discriminative power of a test item is determined by dividing the 
trainees into two groups on the basis of score on the test as a whole: 
high scorers (above the 50th percentile) and low scorers (below the *>0th 
percentile) any test item which is answered correctly by about as many 
low scorers as high scorers is considered to have poor discriminative 
powers. 



concerned with TJhat the students have retained from the electronics 
instruction given the previous month than in any immediate learning* 
This condition also approximates Army instructional requirements be- 
cause several weeks or months generally intervene between completion 
of formal training and on-the-job activity* 

The retention test administered in this study consisted of 70 
representative test items selected from the 10 tests given during the 
first week of instruction* This tost was administered to the trainees 
about one month after the first week's instruction had been completed 
and prior to the beginning of further electronics instruction in the 
course* 

PREPARATION OF INSTRUCTION 
The Instructors 



Four instructors divided the teaching load* All four were members 
of the course staff and had taught some of the material before the ex- 
periment* The work load was divided so that each instructor taught at 
least one but no more than 2 hours on each of the 5 days of instruction* 
They taught the same hours on TV as they did on regular instruction* 

None of the instructors had TV teaching experience prior to this study* 

Teaching Materials 

In regular classroom instruction, the instructor follows a lesson 
plan outline which indicates key items of information to be covered* 

This procedure permits wide variations in the instructor's presentation 
although he may cover the lesson plan objectives* The same procedure 
was used in the television presentations, with the instructors following 
lesson outlines rather than a detailed script* 

Training Aids 

The same training aids were used in both the television and regular 
instruction with the exception that wherever possible actual equipment 
instead of mockups were used in the television presentations* The train- 
ing films employed were presented by projector and screen in the regular 
instruction and over the television receiver in television instruction* 
The blackboard was used frequently in both methods of Instruction* 

Rehearsals 



Each hour was rehearsed at least once, with attention being paid to 
movements in front of the cameras, writing on the blackboard, the handl- 
ing of training aids in front of the cameras, and other of the details 
required for a 'television presentation* The television directors were 
given copies of the lesson plans in which they made notes as to the 
presentation, and which served as their guide* 
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Figuie 2. Trainees in the Powerman* s Course taking a test lifter 
instruction at the Southeastern Signal School# 




Figure 3# Trainees receiving r*le\*lsion instruction in the Powerman’s 
course during the experimental study at the Southeastern 
Signal School, Fort Gordon, Ga, 

? 




Chapter 3 

DESCRIPTION OF EXPERIMENTAL ‘ PROCEDURE 



Description of Instruction 
Training Site 

Both television and regular instruction were presented in the class- 
rooms normally used for instruction in the Fowema^s Co«*«e. .or vS-.c- 
Tision instruction, two 21" receivers were used in the classroom. js>ee 
Figure 3*) In regular instruction, the instructor spoke from a rostrum 
in front of the class. (See Figure U.) The size of the 
never greater than U5« Practical exercises took place in a room with a 
number of tables on which the equipment used could be laid out (See 
Figure $)• 

Regular Instruction 

Normal teaching procedures were followed in regular instruction* An 
attempt, not always successful, was made to eliminate questions and an- 
awva ao u to achieve compan-l'Uity with the television presentations. 

Television Instruction 

The staff used in the TV production included a program director, a 
technical director, an audio man, 2 cameraman and a prop man. Two DuMont 
cameras were used for each presentation, with lenses varying in focal 
length from 2" to 8". Two studios were employed in a single alternation 
series in order that each studio could be set up for the following pre- 
sentation. The presentation was transmitted over a closed-circuit via 
cable. No intercommunication system was used between the class- 
room and instructor, so that the class could not ask or answer questions, 
little or no attempt was made to adapt the regular instruction to tele- 
vision requirements. Special effects, superimposures , closeiqw and 
similar techniques were eliminated or employed minimally. The instructor 
appeared before the camera# and gave his presentation from an outline in 
«ie same manner as in the regular classroom instruction. 

Visual Aids 

Due to toe theoretical nature of much of the material covered, 
relatively few visual aids wera employed. The aids that were enjpleyed 
included come test squipment, the HA-91 rectifier, maintenance record 
forma, traneformer demonstration equipment, and a few othera. tsee 
Figure 6 for an example of a training aid employed in the ^tudy.) The 
blackboard was used very frequently. A demonstration of * rt *£* e J~ - 
respiration techniques was presented. Supertmpoaure swere 
a few instances and no split seresn equipment was available. In geaarai, 
it could be stated that tha production for the major part waa of the 
lecture varisty with some demonstrations of utructure and function of 
equipment. (See Fig. 7 for instruction as it emanated from TV studio). 
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Figure iu Regular classroom instruction during the experimental study 
at the Southeastern Signal School, Fort Gordon, Qa. 




Figure £ 0 Classroom employed for practical exercises in the 
experimental study# 
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Figure 6* Mock-up of the D , Arsonval movement employed in test 
equipment: An example of a training aid employed in 
both regular classroom and TV instruction* 
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Figure 7# Instruction as it originated from the TV studio* 
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Auditing of Instruction 



Both the regular and TV instruction were monitored in order to 
determine what actually went on the classroom and to see if the 
material was covered* The monitor sat in the classroom with a check 
list based on the lesson plans* He used the check list to indicate 
whether or not the material was actually covered* 

Proctors were provided bjr the Test and Evaluation Branch in order to 
keep discipline during the TV presentation* 

INSTRUCTION SCHEDULE 

Appendix C presents the instruction schedule for each week* It 
includes the subject matter} the format of the instruction, l*e*, whether 
conference, demonstration, training film, or practical exercise} the in- 
structor (indicated only by letters); the tines; and the test schedule* 

This schedule was repeated for 8 consecutive weeks with 8 different groups* 
Four presentations were by TV, the other four were regular instruction 
sessions* 
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Chapter U 

ANALYSIS OF RESULTS 



Treatment of Data 

■ p ■■ ■ f — 

The answer sheets were scored by electronic scoring Machines* Be - 
fore scoria; ; each answer sheet was checked for poor erasures and dupli- 
Aoffl answer : . Tally* sheets provided & check on 'he scoring* 

Post Selection and Post Matching of Trainees 

Only trainees completing all 10 teste were considered in the analy- 
sis of results* In order to eliminate initial differences in aptitude, 
a post-matching procedure was employed based upon trainees aptitude test 
scores* Each trainee from the regular classroom group was paired witiva 
trainee from the TV group who had an equivalent aptitude test score* The 
number of trainee pairs employed in the analysis i.ere 62 for immediate 
testing and *>0 for retention testing* For a more detailed description 
of the post-selection and post-matching procedures, see Append!* D. 

Monitor *s Reports 

The monitor system employed in checking whether or not the instruc- 
tion included the information required to answer the test questions was 
found to be inadequate# Therefore, no items were dropped from the te sts* 

Statistical Analysis of Data 

The main statistical tests employed in evaluating the differences 
between the various treatment groups were analysis of variance and the 
t-test# Summaries of the statistical analyses are presented in the 
Appendix* Differences described as "significant at the 5 % lsvel of 
confidence", which is a commonly used standard, will be accepted as 
indications of "real" differences between the various groups. Differences 
not significant at the 5 % level of confidence will be accepted as 
indications of no differences between the groups# 



RESULTS 



Immediate Testing 

Table 2 presents the means for and difference between TV and regular 
instruction on the 10 tests, singly and combined (total score) • These 
results indicate that regular instruction was slightly but consistently 
superior to TV instruction# 



The trainees were divided into two aptitude level groups, with 
the top 31 pairs being treated as the high aptitude level group and the 
bottom 31 pairs being treated as the low aptitude level group# Table 3 
includes the mean raw scores for the various combinations of aptitude- 
media groups on the various tests# Table L includes th^ earns results as 
percentages of the number of items included in the various tests# 
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The high-level aptitude groups were consistently superior to the low- 
level aptitude groups regardless of method of instruction. This result 
indicates that aptitude was the more critical variable in determining 
learning and performance j and instruction medium was of lesser importance** 



TABLE 2 

MEAN RAW SCORES FOR THE 10 TESTS 



TEST 


NO. ITEMS 


REGULAR INSTRUCTION 
MEAN 


TV INSTRUCTION 
MEAN 


DIFFERENCE 


• 

X 


37 


23.3 


21.2 


2*1** 


2 


19 


9.5 


8.3 


1.2** 


3 


38 


22.1 


19*6 


2.5** 


k 


23 


8.3 


7.8 


•5- 


$ 


36 


17.5 


16.6 


.9- 


6 


20 


11.3 


10.5 


.8- 


7 


V 


22.3 


20.5 


1.8** 


8 


23 


10.8 


10*0 


.8- 


9 


38 


22.3 


19.2 


3.1** 


10 

TOTAL 


\/\ 

CM 


17.it 


U.6 


2.8** 


SCORE 


296 


161i.7 


118.5 


16.2** 



#* Significant at the 51 level of confidence* 



*See Appendix i for overall Analysis of Variance and Appendix F for 

Analyses of Variance of individual tests. 
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TABLE 3 



MEAN RAW SCORES FOR MEDIA, APTITUDE IEVEIS 

AND TESTS 



Aptitude Level 



Teat 


No* Items 


Medium 


High 


Low 


T 


37 


Regular 


26.8 


19.8 






TV~ 


23.1l 


19*0 






Combined 


25.1 


19.lt 


II 


19 


Regular 


10.7 


8.3 






TV 


9.5 


7.2 






Combined 


10.1 


7.8 


III 


38 


Regular 


25.1 


18.7 






TV 


22.5 


16.7 




» 


Combined 


2lt.O 


17.7 


IV 


23 


Regular 


9.U 


7.3 






TV 


9.1 


6.6 






Combined 


9.2 


7.0 


V 


36 


Regular 


20.5 


m. 2 






TV 


18.6 


1U.7 






Combined 


19.6 


Uuk 


VI 


20 


Regular 


12.0 


10.6 






TV 


11.6 


9.S 






Combined 


11.8 


10.0 


VII 


37 


Regular 


2iu5 


20.1 






TV 


23.0 


18.1 






Combined 


23.8 


19.1 


vin 


23 


Regular 


11.7 


9.8 






TV 


U.0 


9©1 






Combined 


ll.lt 


9.b 


n 


38 


Regular 


25,7 


16.9 






TV 


22.b 


16.0 






Combined 


2lt*0 


X7.U 


z 


2 $ 


Regular 


18*8 


16.0 






TV 


16.2 


13.1 






Combined 


17.5 


Uu6 


TOTAL 


296 


Regular 


185.6 


1U3.7 






TV 


167.3 


130.0 






Combined 


176.5 


136.8 



TABLE It 

MEAN % SCORES FOR MEDIA, APTITUDE LEVEIS AND TESTS 



I 



o 

ERJC 

il*51IUSa!LJ 



TEST No* ITEMS 



APTITUDE LEVEL DIFF 

MEDIUM HIGH LOW COMBINED BEG - TV 



37 



Regular 

TV 

Combined 



72.U 53.5 



63.0 



5.7 



2 


19 


Regular 

TV 

Combined 


3 


38 


Regular 

TV 


• 




Combined 


k 


23 


Regular 

TV 

Combined 


5 


36 


Regular 

TV 

Combined 


6 


20 


Regular 

TV 

Combined 


7 


37 


Regular 

TV 

Combined 


8 


23 


Regular 

TV 

Combined 


9 


38 


Regular 

TV 

Combined 


10 


25 


Regular 

TV 

Combined 


TOTAL 


296 


Regular 

TV 

Combined 



63.3 


5l.U 


57.3 




67.8 


52.U 


60.0 




56.3 


U3.7 


50.0 




50.0 


37.9 


UU.2 


9.8 


53.2 


Ul.1 


U7.U 




66.9 


U9.2 


57.9 




59.2 


ltlt.O 


51.6 


6.3 


63.2 


U6.6 


5U.7 




ltO.9 


31.7 


36.5 




39.6 


28.7 


33.9 


2.6 


lt0.0 


30.U 


35.2 




56.9 


39 .U 


U8.3 




51.7 


U0.8 


U6.1 


2.2 


5U.lt 


UO.O 


U7.2 




60.0 


53.0 


56.5 




58.0 


U7.5 


53.0 


3.5 


59.0 


5o.o 


55.0 




66.2 


5U.3 


60.3 




62.2 


U8.9 


55.7 


U.6 


6U.3 


51.6 


57.8 




50.9 


U2.6 


U7.0 




U7.8 


39.6 


U3.5 


3.5 


U9.6 


Uo.9 


1)5.2 




67.6 


U9.7 


58.7 




59.0 


it2.0 


50.5 


8*2 


63.2 


U5.8 


5U.5 




75.2 


6U.0 


69.6 




6U.8 


52.U 


58.U 


11.2 


70.0 


58.U 


6U.0 




62.7 


U8.6 


55.7 




56.5 


U3.9 


50.2 


5.5 


59.7 


U6.2 


52.9 
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Retention Teste 



In order to evaluate the retention test results, trainees* Immediate 
scores on the 70 items used in the retention test are used as a base line* 
Table 5 presents the mean immediate and retention scores on the 70 items 
Tor the Regular Classroom and Television Instruction Groups* 



The results for Immediate testing indicate that the Regular Inst rue- 

rilWim was AM + A ^P*1aw4 am — 

W Mf/VA O.VA W WMV AVAOf AOAVU JUIO Vi VSWVAVU UJlVU^e aVNPVOi'i vao 

results for retention indicate that the Television Instruction Group re- 
tained as much as the Regular Instruction Group one month later* 



TABLE $ 

MEAN IMMEDIATE AND RETENTION TEST SCORES 
ON THE 70-ITEM RETENTION TEST 




Regular TV 





N 


Instruction 


Instruction 


Dlff* 


1 


Immediate Score 












High Aptitude 


28 


50.9 


1(6.1 


lu8* 




Lov Aptitude 


22 


39.3 


3h.6 


lu7 


1 1 


Combined 


$0 


U5.8 


1(1.0 




i v 2 


Retention 










) 

? 

? 1 


High Aptitude 


28 


ld(.6 


1(3.5 


1*1 


i i 

: § 

* ) 


Lov Aptitude 


22 


37.1 


33.9 


3.2 




Combined 


50 


Ul.3 


39.3 


2.0 


i J 



* Significant at the 5% level of confidence* 




Chapter 5 

COMPARISON OP THE EFFECTS OF "INTENSIVE" EXPOSURE 
TO TELEVISION AND REGULAR CLASSROOM INSTRUCTION ON 

TRAINING EFFECTIVENESS 



The major question to be answered in this study was whether the 
intensive use of television would produce a greater decline in learn- 
ing than the intensive use of classroom instruction* Table 6, column 
2 , indicates the percentage of differences on the 10 tests between 
television and classroom instruction* Evidence for a greater rate of 
decrease in teaching effectiveness for one of the methods would be a 
consistent increase in the else of the differences with each succeed- 
ing test* Column 3, Table 6, ranks the tests according to the magni- 
tude of the differences found. This ranking provides no evidence that 
Intensive television per se is more detrimental to learning than regu- 
lar classroom instruction* 

The lack of a systematic trend can be seen from Figure 8, which 
presents the. mean test scores on the 10 tests as percentages of total 
possible score for Regular instruction and Television instruction. The 
shaded area represents the change in the differences between media 
after varying amounts of exposure time (compare with Figure 1). 

Because of the limited sensitivity of the experiment, it cannot 
be concluded that there is absolutely no difference between the two 
media in amount of loss in Teaching effectiveness resulting from 
increased exposure time* It can be concluded, however, that the 
differences are at best relatively small, and of little importance.* 



•"See Appendix H for further analysis of the intensive television 
results* 



TABLE 6 



PERCENTAGE DIFFERENCE AND RANK ORDER OF 
DIFFERENCE AS A FUNCTION OF TEST ORDER 



1 

Test 

Order 


2 

Difference 
in % 


3 

Rank Orler o: 
Difference 


1 


9.7 


6 


2 


5.8 


7 


3 


6.3 


8 


U 


2.6 


2 




2.2 


1 


6 


3.5 


3*5 


7 


lu6 


5 


8 


3.5 


3.5 


9 


8.2 


9 


10 


11.2 


ID 



18 




* 



8® 



lOOf 
90 

80 

70 - 
60 - 
60 
40 

90 
80 - 
10 - 
0 



regular instruction 



TV INSTRUCTION 




X 



9 4 8 

TEST 



6 



It 



j 



10 



Figaro 8* 



Tost by test comparisons of regular and 
television instruction (compare with 
figure 1 )♦ 
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Chapter 6 

TELEVISION versus REGULAR INSTRUCTION 



TRAINING 

Although this experiment was not designed to compare the overall 
effectiveness of Television instruction with Regularinstruction, the 

a..*-- 4 .™ The learning results of this experiment 

TZXXZSm of other experiments which indicate 

that television instruction can teach at least as effectively as regul 
instruction (1, 3, 5, 7, 10, 11)* There were some marked differences 
between the television presentation of this experiment and those of prior 
experiments. These differences shall be considered. 

The Nature of the Content 

Previous studies have utilised content involving a great deal of 
visual material, e.g., map reading, assembly and disassembly 
machine eun. etc. The material employed in the present study was for the 
StSSTSf * iheoretical natur7and required little visual Presentation. 
This difference may be of importance in that TV pres ent at ions^h little 
visual material may be much less interesting than comparable regular 
instruction presentations. This may be related to the lack of face to 
face contact between instructor and student. 

Scripts 

The previous studies involved instruction presented from verbatim 
scripts; the instruction in the present study was based on outlines, 
given a good script, the first procedure insures the sane coverage^ the 
material at all times. The use of an outline does not insure J*e mm 
coverage at all times. There is less pressure on the instructor in the 
classroom than there is in the TV studio. The presentation over TV 
require# that the instructor look into the cameras, W . 

from the floorman, watch the monitor, be careful when walking , 

manipulating training aids; at the same time he must prawn* 

It is possible that the coverage of the material was b ®Jterairi more 
complete in the regular instruction situation than in the TV situation. 

Another factor to be considered is the pacing of the presentation. 

In the regular classroom situation, the students can inf ormaUyoonro 
the instructor's pace by means of gestures, questions, etc. The use of 
prompting equipment would also control the pace of the instructo. o a 
certainextent. When an instructor employs an outUneacripti J* 
presentation, he must Judge for himself how slow or how fast th aterial 

should be presented. 

A third factor to be considered in the employment of ou ^ n ® 
in TV presentations is the smoothness of the presentation. The director#, 
cameraraen* 8 floon#en, etc., arc less certain as to the sequence 
They must follow the instructor and thus are liable to make mistakes. 
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Visual Aids 



The presentation suffered from inadequate employment of visual aids* 
Because of tine limitations, the bulk of the training aids were those 
employed in the classroom* These aids, 1(11110 adequate for the classroom, 
were not made for TV. If these aids were made specifically for TV they 
would have been constructed differently. Not only were training aids 
different from whet would normally be employed, but also, the visual 
advantages of TV were not exploited, e.g*, use of split screen, superim= 
posures, or bread boards* 

Instructors 

The instructors had never taught by way of television prior to the 
experiment. They had frequently presented the instruction in the class- 
room prior to the experiment. The first fact moans the instructors had 
to learn new habits of teaching. The second fact suggests the likelihood 
of habi'*' interference* Thus, the instructors had to break old habits when 
instructing over TV and develop new habits* These conditions would most 
likely reduce the effectiveness of the television instruction* 

RETENTION 

The results of this experiment are consistent with those of a previous 
study (7> in indicating that material taught over TV is retained as well 
as material taught in the regular instruction situation. This result 
is important in that performance on the job will be more directly related 
to the retention of instruction than the immediate learning of instruction. 

The fact that there was no significant difference between methods of 
instruction in the retention scores of trainees reduces the importance of 
the initial differences in learning* 

CONCLUSIONS 

This study represents a pioneer attempt to present a relatively large 
segment of an electronics training program by television* The presentation 
may be characterised as "minimal" television in that little attempt was made 
to translate the instruction as regularly presented in the classroom into an 
effective educational television presentation. On the basis of the test 
results, the following conclusions can be drawn; 

1. Television can be employed as a teaching medium intensively (at 
least for one week) without the day-to-day losses in teaching effectiveness 
exceeding to any great extent those normally obtained with regular instruc- 
tion* 

2. "Minimal" television presentations similar to the kind presented in 
this study are not as effective as regular classroom instruction in terms of 
immediate learning* 

3. "Mi nimal " television instruction is remembered as well as regular 
classroom instruction* 

*See Appendix I for a discussion of the advantages and disadvantages of 
"Minimal" television presentations* 
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Appendix A 



NOTES ON THE EXPERIMENTAL DESIGN 

The evaluation of the differential effects of "intensive” exposure 
to television and regular instruction on teaching effectiveness presents 
a rather difficult problem in terms of experimental design* The inclu- 
sion of the controls that would be required to obtain a high degree ox 
sensitivity and to eliminate the confounding influence of non-pertinent 
variables would result in a highly complex design which would be extreme- 
ly costly to administer properly# 

Only large differences in the effects of "intensive” exposure would 
be of any great importance. Therefore, a design with a low degree of 
sensitivity can be employed. It will be recalled that evidence supporting 
the proposition that "intensive" exposure affects television instruction 
differently than regular instruction will be in the form of a systematic 
change in the size of the differences between the two methods of instruc- 
tion. The differences between test means will also be a function of the 
content of the instruction and the tests. Thus the possibility of an 
interaction between media and content of instruction and tests also exists. 
The effect of this interaction would be to increase the error factor and 
reduce the possibility of obtaining a systematic trend# 

If the content of the instruction were highly interdependent, i.e#, 
if mastery of the content frem the second half of the course were depend- 
ent upon the mastery of the content from the first half of the course, the 
initial differences would be compounded. This condition might result in a 
systematic trend. Such a possibility, however, would require consideration 
only in the event that a systematic trend were obtained consistent with the 
direction of the initial differences. 
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Appendix B 

EXAMPIES OF PICTORIAL AND VERBAL TEST ITEMS 
AS EMPLOYED IN THE STUDY 



o 
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1 # In Figure 1, the control at A is 

A* the coarse adjustment switch* 

B. the fine adjustment switch. 

C. the circuit breaker. 

D. the spare fuse box* 




2* In what position would the victim be placed for the chest-pressure 
method of artificial respiration? 



A * B# 




3* To reduce hysteresis 

A* cores are laminated* 

B* cores are made of soft silicon steel* 
C. wires are made of copper. 

D* wires are made of nichrome* 
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4* When the like terminal of two batteries are connected together 
the batteries are connected in 

A* series* 

B# parallel* 

C* series-parallel# 

D# banks* 

5# In Figure 5> voltage in branch A equals 



2 3 



Fig 5 

6. Other things being equal, reducing applied voltage in a circuit 
one half causes 

A# current to double# 

B# no change in current* 

C# resistance to drop by one half# 

D* current to drop by one half* 




A# 


40 V* 


B. 


4 V. 


c. 


2 V. 


D# 


20 V* 

r 


40V 


* 

_i 









Appendix D 

POST SELECTION AND POST MATCHING OF TRAINEES 



Of the 281 trainees taking part in the experiment, 58 were washbacks, 
and no information concerning aptitude test scores was available for 22* 
Another 59 trainees did not complete the 10 tests. Of the remaining lh2, 
78 were in the regular instruction group, and 6U were in the TV ins true-* 
tion. In the process of post-experimental matching of subjects for apti- 
tude, another 18 trainees were dropped* leaving a final sample of 62 
trainees in each group. 

The post-matching procedure was introduced to eliminate the possible 
confounding effect of differences in aptitude* It also served to increase 
the precision of the experiment. A single measure of aptitude was ob- 
tained by first ranking the 11*2 trainees completing the 10 tests in terms 
of their RV, AR, PA, and El scores, and then determining the average rank 
for each trainee. The ranking measure was employed because the El distri- 
bution had an artificial cut-off point* Trainees with equivalent average 
ranks were then paired off, resulting in the final 62 pairs* 

The analysis of the retention data is based on a sample of 50 pairs 
of trainees* Of the 62 pairs of trainees used in the analysis of the 
learning data, 12 had to be dropped because of washbacks repeating the 
course and trainees failing to take the retention test* 
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Appendix S 

O VERALL AHAUSIS OF VARIAJRBt MBDIMtB HOT* 



Source 


df 


K 


f 


Aptitude 


1 


210.08 


36.7b 


Error (b) 

- (aptitude) 


60 


5.72 


«» 


I 

i 

1 I 
« 

1 

1 

1 

1 

1 

e 

1 

a 

a 

l 

« 

a 

i 

a 

a 








Medina 


1 


37.73 


17.87 


Testa 


9 


.03 


.06 


Medina x Teste 


9 


1.05 


2.22 


Medium x Aptitude 


1 


.27 


.13 


Aptitude x Tests 


9 


1.06 


2.38 


Teste x 

Median x Aptitude 


9 


.36 


.76 


errori (w) 
(medium* medium 
r aptitude) 


60 


2.11 




error2 (w) 


5&0 


.lib 


— 


(test* test x 
aptitude) 








error^ (w) 5U0 

(stfidltlK X 10dit# X 


•b7 

tost x aptitude) 


mm 




Significance 

Lsr»l 



O.l? 



0 . 1 * 

2.5* 

2.5* 



#1 _ ord , r to equoto for to»t difficult? and test variance*, all test scores 
traneforwed into etancto-d scops fusing prSStao 

jtK 2 Th ‘ iSTSSKiA S of too? — • 

See (9, pp267-2?3) for discussion of the design* 
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Appendix Q 

ANAIISIS OF VARIANCE OF LEARNING AND RETENTION 





SCORES ON THE 70-ITEM RETENTION TEST** 






Adainietration 




learning 


Retention j 

i 


Source 

Between 


df 


ns 


T 


as 


F - i 

i 

\ 

| 


Aptitude 

level 


1 


327U*30 


29.15* 


1795.23 


17.3l»* ■ | 

I 


error (b) 


IS 


112*32 


m 


103.56 


1 

aw ! 

i 

1 

1 

5 

1 


Between 

Media 


1 


552.25 


7.77* 


108.16 


1 

1.72 


Interaction 


1 


.07 


1 


27.93 


1 


error (v) 


18 


71.09 


- 


62.79 


m 



* f at the $% level of confidence (df - 1# hO) is k*08 
«NSee (9, pp 267-273) for diicuseion of the design. 
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Appendix H 

FURTHER DISCUSSION OF DIFFERENTIAL DECREASE RESULTS 

In this section, we are concerned with determining whether or not 
there is any evidence for systematic change in the size of the differ- 
ence between regular instruction and TV instruction as a function of the 
temporal sequence of the tests# 

The significant interaction between medium and test in the overall 
analysis of variance (see Appendix E) indicates that there are changes 
in the size of the differences, but it doesn’t indicate whether the 
changes are systematic* The rank order correlation between column 1 and 
column 2 of Table 6 is #2 h (Spearman’s rho), which is not a very high 
correlation. The largest and smallest per cent difference is teat 10 
and test 5 respectively. The difference between these two is 9.0$. The 
means of the % differences between the means of the two media for the 
first five and the last five tests were U.5 and 6.2. Wilcoxon’s test 
for unpaired replicates (15) was applied and the difference was found to 
be insignificant* 

Due to the inability to control for differences in tests and the 
instruction upon which the tests are based, no conclusion can be drawn 
with any degree of confidence as to the presence or absence of differ- 
ential decrement. However, it is possible to draw a very rough estimate 
of the limits of the differential decrement factor* One way is to de- 
termine the slope of the best-fitting straight line* This procedure is 
open to the criticise that the arbitrary assumption of linearity of 
regression is made* With this reservation in mind we will present the 
results obtained with the method of least squares (h, pp. 63-65). The 
formula for the best-fitting straight line of the teat differences was 
Y« ~ ,36X / 3.37. The slope was .36 which does not differ significantly 
from a slope of zero (see lh, pg 2U1 for test of significance of slope)* 
Figure 9 presents the obtained differences and the best-fitting straight 
line. It can be seen from this figure that the straight line does not 
match the obtained differences very well* The slope indicates an average 
increase of 0.36$ in the size of the differences with each succeeding 
tost. 



Interpretation of the differential decrement results must be in 
terras of the overall differences favoring regular instruction. This 
difference which was found even in the first test represents a limiting 
factor as to the generality of the conclusions obtained concerning 
differential decrement. That is, the nature of the differential decre- 
ment factor might have been changed if the TV groups test performance 
either equalled or was superior to the test performance of the regular 
instruction group. In cases where the learning of later material is 
dependent upon the learning of prior material, any discrepancy between 
groups in the learning of the earlier material will be compounded in 
the learning of the later material. Therefore, we must recognize the 
limitations placed upon the interpretation of the differential decre- 
ment results by the overall difference. 
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Interpretation of the differential decrement results is further 
limited by the failure to control for instruction and test content* 
Thus, it would be impossible to draw at?/ definitive conclusions from 
these results as to the presence or absence of differential decrement* 
There is, however, a good case for stating that the differential 
decrement factor, if existent, is not exceedingly large, and it should 
have appeared despite variations In Instruction and test content* 

Since it did not, we can assume it to be, at best, relatively small* 
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Figure 9# Beat-fitting straight line of differences be 
tween media on the ten testa* 
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Appendix I 

THE USE OF "MINIMAL" TELEVISION 

"Minimal" television as employed in this study* refers to the pro- 
cedure of transmitting existing classroom instruction over television 
with little or no adaptation of the material to television techniques, 
••g** closeups, split-screen, superimposures, participation, #t e £ As 
a method of television teaching, it is probably the predominant form 
in many areas of military and civilian instruction* From the experi- 
ence and results of this study, the method has the following advantages! 

1. For practical purposes, learning fi'om "minimal" television 
approximates that obtained in the classroom* From a retention viewpoint 
there were no differences, one month lAter, between television and 
classroom instruction* 

2« It ie a relatively inexpensive method of television teaching, 
since it employs existing materials and instructional personnel* 

3. During periods of emergency or mobilization, the rapid transi- 
tion to television dissemination may prove valuable in terms of time 
savings and costs* 

The disadvantages of "minimal" television procedures are: 

1* Teaching effectiveness is limited to that of the original 
classroom or other instruction upon which the television presentation 
is based* 

2. BcrAdca and low motivation inherent in the original instruction 
may even increase in television transmission* 

3* Difficult classroom teaching problems, which such television 
techniques as closeups, superimposures, split-screen might solve, 
cannot be facilitated by "minimal" television* 

h* The instruction is focused upon and dominated by the instructor 
rather than upon critical learning aspects and the lack of participation 
places the students in a passive learning role* 

5>* New instructors watching a "minimal" television presentation are 
dependent upon the s kil ls which the television instructor possessed in 
the classroom rather than any improvements or changes brought about by 
adapting and using television teaching techniques. 

6. Experienced classroom instructors will miss the cues and "feed- 
back" provided by students when teaching over television. Their pacing 
and teaching skills probably are disrupted* 
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7* From a production viewpoint, lack of scripts hinders the plann- 
ing and timing of "minimal" television presentations by the director 
and other television personnel* 

During emergency or mobilization periods, "minimal" television 
presentations can provide, under certain conditions, a lov cost, rapid 
method of instruction and information# For installations just acquiring 

television facilities, n minimajL'' vision iuSwiCv*w *,*~*— > 

experience in the use of television for instruction as well as meet many 
pressing training problems# An example would be the training of large 
groups when only a few qualified instructors are available* However, 
this utilization phase should be gradually superseded by efforts to 
incorporate the advantages of television into military training# These 
efforts would include reorganization of instructional material so as to 
improve teaching effectiveness, reduce training time and improve in- 
structor training along the lines described in previous studies 12;. 
Testing of television program effectiveness, use of prepared scripts and 
the employment of 'special effects" would be part of this more effective 
employment of television training# The use of prompting equipment would 
be important and would achieve a standardization of effective television 
teaching not possible in "minimal" television presentations* 
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